An investigation on visual and audiovisual stimulus based emotion recognition using EEG

نویسندگان

  • M. Murugappan
  • Mohd Rizon Bin Mohammed Juhari
  • R. Nagarajan
  • Sazali Yaacob
چکیده

In this paper, we investigate the possibility of using visual and audio visual stimulus for detecting the human emotion by measuring electroencephalogram (EEG). Visual and audiovisual stimulus based protocols is designed to acquire the EEG signals over five healthy subjects using 63 biosensors. We propose the analysis of EEG signals using discrete wavelet transform and classification using neural network. EEG signals were decomposed into five frequency sub-bands using 'db4' wavelet function and two statistical features were extracted from the alpha band. These statistical features were used as input to the neural network for classifying five emotions (disgust, happy, surprise, sad and anger). In the experiments of recognising human emotions from visual and audiovisual stimulus, the average recognition rate of 56.66% and 66.67% is obtained. The experimental result shows that the audiovisual stimulus based emotion recognition gives better classification accuracy over visual stimulus.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A hybrid EEG-based emotion recognition approach using Wavelet Convolutional Neural Networks (WCNN) and support vector machine

Nowadays, deep learning and convolutional neural networks (CNNs) have become widespread tools in many biomedical engineering studies. CNN is an end-to-end tool which makes processing procedure integrated, but in some situations, this processing tool requires to be fused with machine learning methods to be more accurate. In this paper, a hybrid approach based on deep features extracted from Wave...

متن کامل

Crossmodal integration enhances neural representation of task-relevant features in audiovisual face perception.

Previous studies have shown that audiovisual integration improves identification performance and enhances neural activity in heteromodal brain areas, for example, the posterior superior temporal sulcus/middle temporal gyrus (pSTS/MTG). Furthermore, it has also been demonstrated that attention plays an important role in crossmodal integration. In this study, we considered crossmodal integration ...

متن کامل

Visual, Auditory, and Cross Modal Sensory Processing in Adults with Autism: An EEG Power and BOLD fMRI Investigation

Electroencephalography (EEG) and blood oxygen level dependent functional magnetic resonance imagining (BOLD fMRI) assessed the neurocorrelates of sensory processing of visual and auditory stimuli in 11 adults with autism (ASD) and 10 neurotypical (NT) controls between the ages of 20-28. We hypothesized that ASD performance on combined audiovisual trials would be less accurate with observable de...

متن کامل

Positive emotion impedes emotional but not cognitive conflict processing

Cognitive control enables successful goal-directed behavior by resolving a conflict between opposing action tendencies, while emotional control arises as a consequence of emotional conflict processing such as in irony. While negative emotion facilitates both cognitive and emotional conflict processing, it is unclear how emotional conflict processing is affected by positive emotion (e.g., humor)...

متن کامل

LSTM-Modeling of continuous emotions in an audiovisual affect recognition framework

Automatically recognizing human emotions from spontaneous and non-prototypical real-life data is currently one of the most challenging tasks in the field of affective computing. This article presents our recent advances in assessing dimensional representations of emotion, such as arousal, expectation, power, and valence, in an audiovisual human-computer interaction scenario. Building on previou...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • IJMEI

دوره 1  شماره 

صفحات  -

تاریخ انتشار 2009